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ABSTRACT 

This conference report summarizes the review of 
research on reading methods and materials done for Project 3 of the 
Targeted Research and Development Program on Reading. Critical 
evaluation of 948 research studies was made using the Gephart model. 
Of these, 244 studies were judged acceptable. It was concluded that 
most teachers combined and adapted many methods and much equipment to 
their particular needs. The existence of so many methods and 
materials for teaching beginning reading, based on the assumption 
that if beginning reading instruction is successful all subsequent 
instruction will also be successful, led investigators to conclude 
that a change of focus is needed and that more studies need to be 
done on the effectiveness of specific methods with various groups of 
older students. It was also concluded (1) that the rush to produce 
and acquire new materials should be replaced by more careful field 
tests of new materials before sale and more insistence on 
effectiveness before purchase; (2) that research on effectiveness of 
materials and methods should include adequate data on population 
studied, materials and methods used, and other information which can 
benefit teachers; and (3) that the present state of research leaves 
teachers with no evidence around which to design effective 
instructional methods. References are included. (MS) 
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One of the three objectives of Project ^ of the Targeted Right to 



Read Grants was to answer the following questions concerning the use 
frequency and use distribution of instructional methods, approaches, 
procedures, materials and equipment for reading instruction: 



a. What methods, materials, approaches, equipment 
and procedures are used to teach reading in the 
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U.S. and to what extent? 

b. What methods of reading instruction are built on 
essentially different pools of basic knowledge? 

c. What relationships between methods of reading instruc 
tion and reading achievement of the various subgroups 
in the population can be shown? 

In addition, the research evidence on methods and materials 
in teaching reading was critically evaluated. 
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Procedure : 

in order to accomplish the objectives of this study, it vas necessary 
to locate all existing literature that might be relevant and develop a 
procedure for selecting, systematically revlevlng and analysing that 
literature. A conmlttee of experts from universities representing 
different fields in reading and related disciplines screened and selected 
specific studies, surveys, and other documents from the vast literature 
in the field and advised on all phases of the project. Each item 
selected vas cavefully read and rated by one or more readers.? In 
addition to rating the item on the specific charges of the project, 
readers also iated its research quality based on gephart’s criteria 
( 1 ^ 0 )— the representativeness of the sample studied, the adequacy 
of the deocri.i.tlon of the treatment used, the validity and reliability 
of the measurements and the appropriateness of the data analysis proced.^es 
Of the tens c f thousands of items screened, 9>*8 vere selected by the 
committee as nerltlng evaluation for the section on materials and 
methods. Of these, a total of ?U4 separate articles vere Judged hy the 
reader, as acceptable (l.e., of high or middle quality.) Eighty articles 
dealing vlth methods and 33 on materials were ranked "high" by the evalu- 

ators . 
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Resultst 

M*«t of the research studies on reading methods involved the 
beginning reading stages. l6l of the articles surviving the Gephart 
criteria vere on Grades 1-3, 38 on grades 4-6, ?5 on Jtinior high, 2 
on senior hi^, 10 on young adults (college) and 5 on adults. Further- 
more, vith the exception of "progranoned instruction" and "individualized 
instruction," it is rare that the term, "methods of teaching reading" is 
used above grade 3* 

The most typical finding reported in the studies revieved vas 
"no statistically significant differences uere found betveen experi- 

I 

mental and control groups." This statement appeared with monotonous 
regularity. In the studies which reported significant gains at the 
end of the experimental period, these inevitably disappeared in follow-vp 
studies, and, in some cases, controls exceeded experimental subjects 
in subsequent learning. To be sure there were ^ignif^,cant differences 
in some variables in a few studies. At the present time, we lack even 
a "web of partial evidence" from which teachers can design effective 
methods for teaching reading. 

Hhat the project did reveal were the kinds of problems researchers 
in reading methods face and the assumptions underlying their efforts. 

Definition af Reading Methods: 

Investigators tended to label rather than to give operational 
definitions of reading methods. The classification system developed by 

i Chall ( 1967 ) was used in grouping methods studies: 
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1 - Meaning en 5 >hasis 

2 • Code e/nphasls 

a. synthetic 

b. analytic 

3 - Mnguistics 

U - Iiodified alphabet 

5 - Responsive environment 

6 - Progranmed learning 

7 - Individualized instruction 

8 - Language experience 

9 - Eclectic (author's ovn or other) 

In evaluating the articles, books and other source Tnaterials, it 
vas usually possible to fit the author's label of method into one of 
the above categories, although some researchers only described the 
materials used in the study. Pev studies explicitly described teaching 
methods and almost none gave information concerning the sequencing of 
the exact elements in the instructional plan, the type and amount of 
practice trials for each aspect of the presentation, the kinds of 
reinforcement used by teachers, nor the total time devoted to the 
procedure under study. Most of the research merely labeled the "method" 
used without operationally defining it In many cases, quite different 
practices vere labeled vith the same, terra (e.g., "individualized instruc- 
tion" vas used to describe programs where students freely chose their 
ovn books to read as well as programs where students followed a rigidly 
prescribed prograjined learning instruction sequence; "responsive 
environment" referred both to the "Talking l^ewriter" and to sundry 
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varintions on the British Infant School model.) The term, "method" 
also vas applied to quite different phenomena: e.g., classroom organi- 

zation, overall nature of the instruction, materials used and even to 
the basic "approach" or philosophy Involved. In almost all of the 
methods studies, materials are inextricably linked vith method. 

Ptor example, in the i.t.a. studies, it is iit^wssible to determine 
vhether the differences reported were due to learning to read in the 
nev alphabet or to differences in the materials or classroom strategies 
since students in i.t.a. classes typically used the Early to Read Series 
and controls used, "basal readers." (Warburton and Southgate, 1969 ) 

Studies using "linguistic methods" showed even greater variability 
in terms of materials used, often appearing indistinguishable from 
"phonics-bbjed" programs. Inevitably, control groups were taught 
with the "traditional basal reader" approach. In most studies, the 
specific basal reader used was not identified nor was descriptive 
information given as to hew the teacher used or supplemented the 
basal render materials. 

Not only did label.s used to describe reading methods have quite 
different meanings depending on the author, but more sophisticated 
attempts to classify different reading approaches coiqwunded the confusion 
For example, the Bliesmer and Yarborou^^i study (1965) which compared 
10 reading methods has been videl,/ cited as demonstrating the superiority 
of the syntheti(' approach. A careful inspection of the data tliey cite 

reveals the following: 

1. The "individualized approach" which they classify as analytic 
differs significantly from each of the other analytic approaches on 
at least one comparison. 5 

ERIC 
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2. The "individualized approach" clasaified as analytic did not 
differ significantly on any comparison from the "programmed 
learning approach" vhich they classified as synthetic. 

3. On 17 out of 50 conpari sons, the synthetic methods differed 
significantly from each other. 3 

Jean Chall in her book T.parning to Read; The Great Deba^ takes 
great pains to illustrate that selections from phonics-based readers do 
not differ from meaning-emphasis materials on meaningfulness, but then 
proceeds to classify them in different categories. In her analysis of 
the research she undertakes a deep and scientifically rigorous look at 
theexistlng research, but finds herself faced vith the problem shared 
by all synthesizers— i.e., if research quality standards are too high, 
there is nothing left to summarize. Chall resolves the dilenma by 
accepting studies vith recognized major defects on the ground that they 
are "as good as most studies of their kind." Thou.^ she claims that her 
conclusions stem from her theoretical analysis of the probable course 
of reading skill, not from "head-counting results," her study still 
leaves one vith the impression that one can merely examine the research 
literature no matter hov inadequate it is and conclusions vill emerge. 

Authors of textbooks, professors of reading, and investigators vho 
engage in research rituals assume that reading methods exist and that 
they differ. We have found no evidence to support either assumption. 

What the teacher does vith materials and lesson plans vhen he or she 
closes the classroom door has rarely been reported in the reading 
research literature. That teachers ignore the controversy on reading 
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pt» in the final report of the project. (Corder, 197 .) 
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methods Is suggested from survey dete. Btor example. In the Rev England 
Educational Assessment Project (I969), of the first grade teachers 
reported using basal reader materials, but reported they also used 
intensive phonics materials. The majority of the teachers said they 
also used s«TOle«entary basal materials, teacher-made exercises, tape- 
recorders, etc, to teach reading. Ninety percent of the first grade 
teachers put some or much emphasis on configuration clues (vhole word 
approach), ninety-eight percent stressed phonics (letter sounds) and 
the majority of the group also claimed they stressed linguistics (vord 
patterns) and structural analysis. It vould appear that teachers use a 
vide variety of materials and approaches in teaching reading. 

Other Assumptions Underlying Res earch in Beginning Headi^ 

Jhpllclt in much of the research in beginning reading is the 
assumption that if a child is started out rl^t at the beginning stages, 
the advantages he gains over other students in reading achievement vill 
persist permanently. Eollov-up studies typically Involve periodically 
administering reading tests in subsequent years vlthout considering the 
intervening learning experiences or the impact of other factors on 
reading development, longitudinal studies tracing the child's reading 
development and educational experiences are rare Indeed. If this research 
direction continues, one can confidently predict that soon studies vill 
be reported vhere the achievement of students taught beginning reading 
in l.t.a. is compared vlth controls on College Board Examination Scores 

adninstered tvelve years later. 

Another research assumption is that it is good to get children 
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readlng early and the faster they learn, the better. This value Judge- 
ment has no empirical basis and runs counter to our knovledge of the 
differential patterns of child development and motivational stages in 
cognitive, emotional and physical areas. 

lB 5 >licit also in the development of "methods" is the viev that if 
the initial stages of learning to read can be made easier by changing 
the code, controlling the sequence of presentation of letters of the 
alphabet, teaching phonics rules or controlling the vocabulaiy, etc., 
the child vill learn to read more easily and quickly. With the sole 
exception of i.t.a. research, none of the other investigators have 
mentioned the problem of transfer, much less studied it. These 
attempts may oversiaplify the process of reading to a degree that 
children raav not be adequately prepared to make the transition to 
"real reading involving as it does irregular and polysyllabic vords, 
Inconsistent spelling patterns and pronunciation, and complex syntax. 

It is q\iite possible that simplifying the beginning reading stimuli may 
indeed result in negative transfer making it more difficult for some 
children to make the transition to normal vritten material. Systematic 
research on transfer is sorely needed. 

underlying most of the research and vritten materials on methods, 
despite protestation to the contrary, is the undisguised hope that if 
only ve are careful and scientific enou^ ve vill eventually discover 
the one method of teaching reading that vill vork vith all children. 
Materials; 

There are veil over 10, COO separate products to teach reading on 
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the market today including books, filmstrips, multi-level kits, games, 
etc. This information explosion poses a dilemma for the reading 
educator vho is responsible for making decisions about vhich materials 
to use. P. Kenneth Kbmoskl, President of the Educational Products 
Information Exchange Institute, a consumer’s union for school systems 
and educators estimates that less than ten percent of the educational 
products on the market today have been field tested, and far fever have 
been subject to more rigorous learner verification testing. (Kbmoski, 
1971) Current products for teaching reading being developed by the 
various regional educational laboratories are being rigorously tested and 
revised. Fbr exaa?)le, the First Tear Conmwnications Skills Program 
developed by the Southwest Regional Laboratory (SWRL) has been learner- 
verified by testing and used with more than 30,CXX) children in twelve 
states over a fo'or-year period. The Wisconsin Design for Reading Skills 
Development (Otto and Aakov, 1970) represents another approach in which 
research has been used to develop interrelated components of basic skills 
for grades one ttoou^ six with the goal of aiding schools to make more 
efficient use of available published materials rather than developing 
new materials. In evaluating these as well as other systems approaches 
to the teaching of reading, it is important to recognise that they are 
designed to supplem ent not suppla.it the regular school reading program. 

A comprehensive list of materials "purported to be distinctly 
phonics programs" was compiled by the Educational Products Information 
Exchange and published as .duct Information Supplement No. 7: Text- 

b..pd Iconic. ProgTM.," in April, 1969. Over forty percent of the 1«9 
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titlGS listed vere reported to have undergone some sort of field testing. 

Fev materials designed for high school and college level students 
have been field tested. An exception is the McGrav-Hill Basic Skills 
System vhich includes programmed books for learning a number of reading 
and study skills and is designed for high school and college students. 

Komoski (l97l) fears that the proliferation of educational materials 
has lead to providing schools and teachers vith an increasing number 
of trivial options rather than the hi^ quality alternatives they need. 

The plethora of educational materials is syii?>tomatic of our technolo- 
gical age vhich creates a demand for options in all purchases as veil 
as a need fbr inmediate acquisition of products and information. Teachers, 
like other consumers, have been conditioned to expect new materials and 
methods every year and to look to educational technology to help solve 
classroom problems. (An illustration of this attitude was the incident 
at the 1970 National Reading Conference vhen a teacher rose to protest 
the goverraent’s spending money on long-term research when vhat she 
needed vas something to use in the classroom "Monday morning. ) 

Field-testing nev materials is an expensive proposition. Publishers 
are unlikely to underv^rite this additional production cost voluntarily, 
particularly since educators do not demand evidence that the product 
they are purchasing has been tested and, in Ibct, generally ignore field 

testing data vhen they are available. 

Even vere all materials sold to schools required to have demonstrated 
learner effectiveness on a nation-wide sample, this would not guarantee 
that the materials would work equally well with a particular sub-group 
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popul.tion in . local achool district. School 8jr.t«» need help in 
establishing criteria for th.-ir local needs and in developing inexpen- 
sive pilot-testing program so that iterials can he tested on local 

populations . 



itae of Materials in leac hing Beading 

We fovmd no recently published, large-scale national surveys on 

the use and distribution of reading aaterials in the schools. The 
local and regional surveys and lisilted national surveys that ve revieved 
uncovered no evidence that vould refute the findings of earlier surveys that 
Basal readers are used in alnost aU eleaentaw classrooas in grades 
K-6. (Austin and Itorrison, 1963, Barton and Wilder, 196U.) However, 
as mentioned above, regional surveys suggest that most elementary teachers 
are s,,g.le»entlng basal readers with other materials such as Intensive 
phonics workbooks, teacher built sateriala, and audio-visual aids 
especially tape recorders. Despite the criticism of basal readers 
expressed by reading experts and the public press, there was no evidence 
that classroom teachers are rebelling against them nor using them less 



frequently . 

Regional surveys of hijSi school reading programs suggest that 
machines, multl-le-vel kits, and workbooks are still the most frequently 

used materials. 

The language-experience approach, i.t.a., and individualized 
instruction, although described frequently in educational publications, 
actually involve only a very small percentage of classrooms as revealed 
by the surveys. Computer assisted instruction In reading, perhaps 
because of its expense, has made few inroads in public schools and is 

generally limited to a fev research projects. 
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The Knovledge Base of Methods and Materials In Reading: 

Aljnost all of the so called methods of teaching reading reported 
in current literatiire, including i.t.a., have their roots or counterparts 
in practices described in the professional literature of the nineteenth 
century. Proponents of current methods and approaches have selectively 
dravn evidence from the research literature in psychology and linguistics 
to support their positions. Usually they focus their rationalizations 
on one particular branch of psychology and ignore or underplay findings 
from other areas. Ibr exan?>le, the rationale for individualized 
instruction, responsive environaent, language experience approaches 
>iave in conmon an assusption that children can learn to read in a less 
structured situation then the normal classroom provides . They cite 
psychological evidence on motivation, differential growth and develop- 
ment patterns and studies on individual differences to support their 
positions. Analytic and synthetic method proponents cite studies from 
visual perception and learning to support their positions, but ignore 
findings which do not support their theory. 

Inter-relationships Between Methods and Materials, Characteristics of 
the Learner and Reading Achievement. 

The research literatime dealing with the relationship between 
characteristics of various sub-popuJL&tions and naterials and methods 
used in teaching reading revealed little information. Most stxidies 
fsdled to specify the obvious descriptors of the population studied- 
sex, intelligence , ethnicity, or socio-econaaic background. Only two 
studies on American Indians survived the fephart screening system and 
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only fo\ip dealing vith Asi&s-A*erican st\idents . In one of the "Indian” 
studies , the Indian population vas cooprised of two Indian children. 

Most of the studies which specified ethnicity concerned Black, 
low students in ^etto schools. No studies meeting o^or research 
criteria were found on middle- class Black children nor on hi^ SES 
White children with reading difficulties . 

If further research is conducted on questions involving school 
procedures and materials for special groi 5 >s, researchers should he 
req'uired to provide adequate data on their po»pulations Including sex, 
ethnicity, ability, grade level, SES teckground as well as other relevant 
reading characteristics including physicstl, emotional and perceptual 
difficulties. 

It my appear to many that the review of over 900 articles on 
reading methods and mterials selected as pertinent to the interests 

concerns of this project should yield more information. TSiat it 
did not was a constant concern to those who put extensive, time-consuming 
and detailed effort into conpleting the project. The inplications of 
this study are crystal clear. It is tine to refocus the research effort 
in reading, to raise the stajiktards of designing, conducting and reporting 
of reading research so that these efforts are conpatible with standards 
of resear di investigation and reporting that scientists have accepted 
in developing and coamunicating their findings. Incomplete, small and 
partial studies where only the ejqperlnenter \ising his clinical insi^jits 
can interpret the results may be useful in shaping opinion and developing 
hypotheses for future research. However, one cannot trust, much less 
apply informtion develoiped from studies that are incooplete, fall to 
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control for siffiificant variablcB, are baaed on s«all popolations, do 
not adequately describe characteristics of the saaqple) do not specify 
the conditions under which the stiuJy was conducted, fail to specify 
operational definitions of the variables used (whether they be teacher 
characteristics, p\5>il characteristics, nethods or materials) and state 
conclusions that are not ’ supported by the data* 

If resulins research is to inprove, then it js the responsibility 
of editors of professional Jourmls and other publications, Individuals 
responsible fdr the awarding of grants and the research consumers to 

Bx>re rigorous standards • Researchers must recognise that sophisti- 
cated statistical treatments, and elaborate esqperiJBBHtal designs will 
not yield answers to poorly stated questions nor clarify fuzny concepts. 
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